Python Job: Senior Azure Data Architect - Remote Work

About the job Senior Azure Data Architect

Summary of Duties & Responsibilities

This client is a U.S. SaaS company that builds ERP solutions for AEC firms. They have an opening for a Senior Azure Data Architect on their Artificial Intelligence and Analytics team (AI+A). This is a greenfield opportunity to develop an AI and Analytics application in the ERP space. The Senior Azure Data Architect is responsible for designing and implementing Big Data and BI solutions using the Microsoft Azure platform. This role is 75% hands-on coding and 25% architecting Big Data and BI solutions.

The candidate must have at least 7 years of hands-on Azure expertise in designing and developing scalable multi-tenant Big Data and machine learning products using Azure Data Lake Gen2, Azure Databricks, Power BI, Data Pipelines for near real-time data analytics and machine learning, and near real-time Azure SQL cloud-based data warehouse. The ideal candidate will be an expert with 10 years of hands-on experience in designing, implementing, and delivering into production, large-scale near real-time data warehouse.

The Senior Azure Data Architect is expected to evangelize and educate others on engineering design and development standards. Senior Azure Data Architect is expected to function as a productive member of a team, working and communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers.

The ideal candidate is an exceptional critical thinker that is adept at solving complex problems and designing and developing elegant business solutions.

Essential Functions

• Design and develop data pipelines.
• Design and develop Azure ML model execution architecture.
• Design and develop methods for handling 3rd party data for use within ML models.
• Evangelize engineering design and development standards.
• Acts as a key contributor to the design and development lifecycle of analytic applications utilizing Microsoft Azure and BI technology platforms.
• Participate in Agile ceremonies including daily stand-ups, sprint planning, retrospectives, and product demonstrations.
• Produce efficient and elegant code that meets business requirements
• Author unit tests that adhere to code coverage guidelines.
• Proactively communicate progress, issues, and risks to stakeholders.
• Accurately estimate assignments.
• Create and maintain technical documentation.
• Mentor less experienced engineers.
• Contribute to the growth and maturity of the Software Engineering Group.
• Performs other related duties as directed.

Required Skills & Competencies

• 7 years of hands-on experience designing and implementing multi-tenant solutions using Azure Databricks for data governance, data pipelines for near real-time data warehouse, and machine learning solutions.
• 10 years of extensive, hands-on experience designing and implementing large-scale multi-tenant distributed data architecture for BI and OLTP systems.
• 5 years of hands-on experience designing and developing multi-tenant solutions using Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow.
• 10 years of advanced hands-on experience designing and implementing large-scale multi-tenant data pipeline (TB or PB in size) including Change Data Capture (CDC) solutions for structured, semi-structured, and unstructured data in batch and real-time environments.
• 5 years of hands-on experience in Azure services including Azure SQL Database, Azure Databricks, Azure Analysis Services, Azure ML Services, and Azure Synapse Analytics.
• 5 years of hands-on experience with data integration using ETL / ELT tools (e.g., SSIS, Azure Data Factory, Airflow).
• Advanced knowledge of Python, Object-Oriented Programming, and unit testing.
• Expert in data modeling.
• Broad experience in Microsoft SQL technologies including SSAS Tabular models, DAX, T-SQL, Service Broker, Replication, and Performance Tuning.
• Broad multi-tenant data architecture and implementation experience across different data stores (e. g., Azure Data Lake GEN2, Azure SQL Data Warehouse, Azure Blob Storage, HDFS), messaging systems (e. g., Azure Event Hubs, Apache Kafka), and data processing engines (e. g., Azure Data Lake Analytics, Apache Hadoop, Apache Spark, Apache Storm, Azure HDInsight).
• Experience with Pandas and parallel processing. Experience with Ray is a plus.
• Experience with data integration through APIs, Web Services, SOAP, and/or REST services.
• Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence.
• Additional programming experience is a plus including experience with NET, Scala, R, Java.
• Must have demonstrated experience designing and implementing data pipelines for consumption by machine learning and BI solutions.
• Knowledge of SOA and Micros Services Application Architecture.
• Ability to work in a fast-paced, collaborative team environment.
• Excellent written and verbal communication skills and ability to express ideas clearly and concisely.

Education or Prior Work Experience

• Bachelor's degree in CS or related field, master's degree preferred.
• 10+ years of experience with designing and developing complex data architecture solutions.
• 5+ years of design and development experience with Microsoft Azure data architecture and related solutions (e.g., Azure Data Lake Gen2, Azure Data Factory, CDM, Event Hub, Azure Databricks, Synapse, Azure SQL DW).

Tipo de puesto: Tiempo completo

Salario: $100,00 - $200,00 al mes